CLAIMS 

What is claimed is: 



1 1 . A method comprising: 

2 scheduling an instruction for execution; 

3 speculatively executing said instruction; 

4 determining whether said instruction executed correctly; 

5 routing said instruction to a replay mechanism if said instruction did not execute 

6 correctly; 

7 determining whether a replay tornado exists; 

8 routing said instruction for re-execution if said instruction executed incorrectly and no 

9 replay tornado exists; and 

1|| breaking said replay tornado if said replay tornado exists, said breaking comprising: 

M retiring replay safe instructions in said pipeline; 

lit marking non-replay safe instructions in said pipeline for re-execution; 

fi and 

p rescheduling said non-replay safe instructions for re-execution. 

Jj 2. The method of claim 1 further comprising tracking length of time that has elapsed since a 

2 last primary replay cause was detected. 

1 3. The method of claim 2 wherein said determining whether a replay tornado exists further 

2 comprises checking if said length of time that has elapsed has exceeded a tornado detection time 

3 limit when a secondary replaying instruction is detected. 

14. A method comprising: 

2 scheduling an instruction for execution; 

3 speculatively executing said instruction; 

4 determining whether said instruction executed correctly; 

5 routing said instruction to a replay mechanism if said instruction did not execute 

6 correctly; and 

7 choosing a replay mechanism that will not put said instruction back into execution 
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8 immediately said instruction cannot be executed successfully for a relatively long time. 

1 5. The method of claim 4 wherein an incorrectly executed instruction is not put back into 

2 execution until when a signal indicates that said incorrectly executed instruction can be executed 

3 correctly. 

1 6. The method of claim 5 further comprising placing said incorrectly executed instruction 

2 back into execution in a manner that will not start a tornado. 

1 7. The method of claim 6 wherein said placing said incorrectly executed instruction back 

2 into execution in a manner that will not start a tornado comprises: 

Qf entering instructions that are not replay safe into a scheduler in program order; 

S setting a result register for each of said instructions entering said scheduler; and 

# scheduling said instructions for execution. 

2 

tJ i 8. A method comprising: 

li storing an instruction in a queue, said queue to store a plurality of instructions and 

S| information related to each of said instructions, said information comprising a set of status 

Jj bits for each of said instructions; 

h§ scheduling said instruction; 

6 speculatively executing said instruction; 

7 checking whether said instruction executed correctly; 

8 flagging said instruction for replay if said instruction did not execute correctly; 

9 determining whether a replay tornado exists and if said instruction is part of said replay 

10 tornado; 

1 1 retiring replay safe instructions and 

12 rescheduling said non-replay safe instructions for re-execution. 

1 9. The method of claim 8 further comprising toggling status bits in said queue for said non- 

2 replay safe instructions to indicate need to reschedule and re-execute said non-reply safe 

3 instructions. 
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1 10. The method of claim 9 further comprising tracking amount of time since a last primary 

2 replay cause. 

1 11. The method of claim 10 wherein said determining whether said replay tornado exists 

2 further comprises comparing said time since said last primary replay cause with a time limit, 

3 wherein said replay tornado exists if said time since said last primary replay cause exceeds said 

4 time limit when a secondary replaying instruction is detected. 

1 12. The method of claim 1 1 wherein said determining whether said replay tornado exists 

2 further comprises measuring a current rate of replay and determining whether a tornado exists if 

3 said current rate of replay exceeds a time limit since said last primary replay cause. 

JfS 13. The method of claim 9 wherein a primary cause instruction is added to a list of replay 

J§ tornado causing instructions if said replay tornado exists and said primary cause was said last 

It primary replay cause before detection of the tornado. 

H 14. The method of claim 13 wherein said list of replay tornado causing instructions is used to 

|J predict instructions that are likely to cause replay tornadoes. 

H 15. The method of claim 14 wherein instructions determined to have not produced a correct 

2 result are put back into execution in a manner that will not start tornadoes if said instructions are 

3 predicted to be likely to cause replay tornadoes. 

1 16. The method of claim 15 further comprising: 

2 entering said instructions that are not replay safe into a scheduler in program order; 

3 providing results to said instructions entering said scheduler; and 

4 scheduling said instructions for execution. 

1 17. A processor comprising: 

2 a scheduler to dispatch instructions, said scheduler comprising a scheduler queue to store 

3 said instructions and a status associated to each of said instructions, said scheduler to store 
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4 each instruction until that instruction is indicated to be replay safe; 

5 an execution unit coupled to said scheduler, said execution unit to execute said 

6 instructions; 

7 a checker coupled to said execution unit, said checker to determine whether each 

8 instruction has executed correctly; and 

9 a replay mechanism coupled to said checker, said replay mechanism to receive an 

10 indication from said checker for each instruction that has not executed correctly, said replay 

1 1 mechanism further comprising logic to determine whether a replay tornado exists and 

12 whether said incorrectly executed instruction is part of said replay tornado, said replay 

13 mechanism further comprising a tornado stopping mechanism to break said replay tornado. 

2 18. The processor of claim 17 wherein said tornado stopping mechanism comprises logic to 

f2J retire replay safe instructions in an execution pipeline, and to set statuses for said non-replay safe 

M instructions to indicated a need for rescheduling said non-replay safe instructions. 

sl 19. The processor of claim 18 wherein said status associated to each of said instructions 

S comprises a set of bits to indicate if associated instruction is replay safe, is part of a replay 

|3r tornado, is being replayed, and has been dispatched. 

Q 

4 s 20. The processor of claim 19 wherein said indication from said checker causes said replay 

2 mechanism to request said scheduler to reschedule said incorrectly executed instruction for re- 

3 execution if no replay tornado is present. 

1 21 . The processor of claim 20 further comprising: 

2 a retirement unit coupled to said checker to receive any instructions that have executed 

3 correctly, said retirement unit to retire said instructions that have executed correctly; 

4 a first level internal cache coupled to said execution unit; and 

5 a second level internal cache coupled to said execution, wherein access time to said 

6 second level internal cache is greater than to said first level cache. 

1 22. The processor of claim 21 wherein said processor is coupled to an external main memory 
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2 and to a disk memory. 

1 23. The processor of claim 22 wherein said incorrectly executed instruction is a memory load 

2 operation, said memory load instruction operation to cause a memory fetch, said memory fetch to 

3 search through a memory hierarchy for requested data, wherein said memory hierarchy 

4 comprises of said first level cache, said second level cache, said external main memory, and 

5 wherein said first level cache has fastest access time and said main memory has longest access 

6 time; and wherein each incorrect execution of said memory load instruction causes said memory 

7 fetch to access a slower level of memory, and said logic increases said time delay to approximate 

8 an access latency to said slower level of memory. 



y 24. A system comprising: 

Hi a memory coupled to a bus; 

a processor coupled to said bus, said processor comprising: 

a scheduler to dispatch instructions, said scheduler comprising a scheduler queue 

S to store said instructions and a status associated to each of said instructions, said 

J| scheduler to store each instruction until that instruction is indicated to be replay safe; 

fjl an execution unit coupled to said scheduler, said execution unit to execute said 

|S instructions; 

1) a checker coupled to said execution unit, said checker to determine whether each 

10 instruction has executed correctly; and 

11 a replay mechanism coupled to said checker, said replay mechanism to receive an 

12 indication from said checker for each instruction that has not executed correctly, said 

13 replay mechanism further comprising logic to determine whether a replay tornado 

14 exists and whether said incorrectly executed instruction is part of said replay tornado, 

15 said replay mechanism further comprising a tornado stopping mechanism to break 

16 said replay tornado . 

1 25. The system of claim 24 wherein said tornado stopping mechanism comprises logic to 



2 retire replay safe instructions in an execution pipeline, and to set statuses for said non-replay safe 

3 instructions to indicated a need for rescheduling said non-replay safe instructions. 
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1 26. The system of claim 25 wherein said replay mechanism further comprises a timer to track 

2 a time since a last primary replay cause instructions, wherein said tornado stopping mechanism 

3 uses said time since said last primary cause when a secondary replaying instruction is executing 

4 to determine whether said replay tornado exists. 

1 27. The system of claim 26 wherein said indication from said checker causes said replay 

2 mechanism to request said scheduler to reschedule said incorrectly executed instruction for re- 
3. execution in a tornado free manner. 



-27- 



Atty Docket No. 42390.P12010 



